21. BPTT Quiz 2

_A folded RNN model_

A folded RNN model

Lets look at the same folded model again (displayed above). Assume that the error is noted by the symbol E. What is the update rule of weight matrix V1 at time t, over a single timestep ?

SOLUTION: Equation B

Solution

Equation B Is the only equation with the correct derivation of the chain rule with the proper use of the learning rate.

Next Concept